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A signal processing apparatus and method for providing interpolated values between sampled values in a sampled 
image signal, is characterized by means (64, 66, 68) for providing a plurality of different interpolation routines for produ- 
cing interpolated signal values S' for appropriately completing a respective plurality of known features, means (70) for de- 
tecting which of the geometrical image features is represented by a neighborhood of sample values and means (72) for ap- 
plying the interpolation routine appropriate for completing the detected feature, to produce the interpolated signal value 
S'. The signal processing method and apparatus has the advantage that reconstruction errors in the reproduced image are 
reduced. In one mode of the invention for processing images to be viewed by humans, reconstruction errors are forced to 
occur in areas of the image composed of natural textures where the errors are not readily visible to the human observer. 
The appearance of the reconstructed image is thereby improved. The invention is useful in amateur or professional video 
and still imaging apparatus, in graphic arts apparatus and in machine vision systems. 
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SIGNAL PROCESSING METHOD AND APPARATUS 
FOR SAMPLED IMAGE SIGNALS 
Technical Field 

The invention relates to a signal processing 
5 method and apparatus for providing interpolated val- 
ues between the .sample values in a sampled image 
signal . 

Background Art 

In a single-chip color image sensor, image 

10 sensing elements for luminance information (e.g. 
green or white) are spatially separated by image 
sensing elements for chrominance information (e.g. 
red and blue or cyan and yellow), leaving gaps be- 
tween the luminance samples in the luminance signal 

15 produced by the image sensor. These gaps are usually 
filled in by some signal processing method involving 
interpolation; 

U.S. Patent No. 4,176,373 issued 
November 27, 1979 to P. L. P. Dillon, shows a method 
for processing sampled image signals produced by an 
image sensor having a checkerboard luminance sampling 
pattern. The method involves linear interpolation 
(equivalent to finding the mean of the neighboring 
samples). The patent discloses linear interpolation 
25 along a horizontal line, and mentions that -the method 
could be carried out in two dimensions by using 
samples from neighboring lines. 

FIG. 1 shows a color sampling pattern for a 
single-chip color image sensor. The luminance sam- 
30 pling elements, labeled G, are separated by chromi- 
nance-sampling elements, labeled R and B. FIG.. 2A 
represents an image of a sharp vertical line. The 
elements labeled 100 represent high brightness and 
the elements labeled 0 represent low brightness. 
35 FIG. 2B represents the sampled values obtained from 
sampling the image of FIG. 2A with the luminance sam- 
pling pattern of FIG. 1. When linear interpolation 
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is applied to the values shown in FIG. 2B , using the 
values of the four nearest neighbors (i.e. top, bot- 
tom, right and left) surrounding each interpolation 
location, the pattern illustrated in FIG, 2C is 
5 obtained . 

As seen *in FIG. 2C, the originally sharp 
vertical edge has been modulated with a pattern 
corresponding to the luminance sampling pattern. 
Similarly, when a thin stripe, such as the vertical 

10 stripe shown in FIG. 3A is sampled (the resulting 
samples are shown in FIG. 3B) , and reconstructed 
using linear interpolation between the four nearest 
neighbors, the stripe is modulated with a pattern 
corresponding to the luminance sampling pattern as 

15 shown in FIG. 3C. 

In an image intended for human viewing, 
these reconstruction. errors are most objectionable in 
geometrical details such as edges, lines and cor- 
ners . In an Image intended for machine interpreta- 

20 tion, such as a robot vision system used in a fac- 
tory, the reconstruction errors are most objection- 
able when they interfere with the efficient operation 
of the system. For example, when the reconstruction 
error results in ambiguity as to the identification 

25 of a part on an assembly line. 

Of course, the reconstruction errors may be 
reduced by increasing the number of image sensing 
elements In the image sensor but this increases the 
cost and complexity of the image sensor. 

30 There Is a need therefore for a signal pro- 

cessing method and apparatus for providing interpo- 
lated values between the signal values In a sampled 
image signal, that reduces the reconstruction errors 
In an image reconstructed from the processed image 

35 signal. 
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Disclosure of the Invention 

It is the object of the present invention to 
provide a signal processing method and apparatus for 
interpolating signal values between sampled values in 
5 a sampled image signal, whereby the reconstruction 
errors in an image reproduced from the processed 
image signal are reduced. 

Basically the object of the invention is 
achieved by employing an interpolation method that 

10 uses prior knowledge about features existing in the 
images being reconstructed. A plurality of different 
interpolation routines are provided for completing 
the respective features. Local neighborhoods of 
image samples around an interpolation location are 

15 examined and the particular feature existing in the 
neighborhood is detected, then the interpolation 
routine' appropriate for the detected feature is 
applied. By using the prior knowledge about the 
features existing in the image, the reconstruction 

20 errors in the image reproduced from the processed 
image signal are reduced. 

When the signal processing method is applied 
to image signals intended for human viewing, geomet- 
rical features such as edges, lines and corners are 

25 assumed to exist in the image, and the interpolation 
routines are fashioned accordingly. The reconstruc- 
tion errors remaining in the reproduced image occur 
mainly in natural objects having more irregular fea- 
tures, such as foliage, where the reconstruction 

30 errors are hardly noticeable to a human observer. As 
a result, the appearance of the reconstructed image 
Is significantly improved. 

The signal processing method is character- 
ized by: 1) providing a plurality of different 

35 interpolation routines for producing interpolated 

signal values appropriate for completing a respective 
plurality of known geometrical image features; 2) 
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detecting which of the known geometrical image fea- 
tures is represented by a neighborhood of sample 
values; and 3) applying the interpolation routine 
appropriate for completing the detected feature to 
the neighboring sample values to produce the inter- 
polated signal value. 

In a preferred embodiment of the invention, 
for processing a sampled image signal from an -image 
sensor having a checkerboard -type sampling pattern, 
for producing images intended for human viewing, the 
image features are detected in a four-sample local 
neighborhood. The features include an edge, a 
stripe, and a corner. For the edge feature, the 
interpolation routine comprises producing the median 
15 value of the four surrounding sample values, where 
the median is defined as a value halfway between the 
two middle sample values. For the stripe feature, 
the interpolation routine is a function of the twelve 
nearest neighbors defined as 

20 X - CLIP I (M-(S-M)) 

where : 

X is the interpolated value, 
A IB > C > D are the values of the 
25 four nearest neighboring samples in rank order, 

M is the median value of the four nearest 
neighboring samples, 

S is the mean value of the eight next near- 
est neighboring samples, and 

30 CLIP J (i) « j if (j < i or i- < j < k) 

i if k i i < j 
k if (i < k or i < k < j) . 

The interpolation routine for the corner detail is a 
35 similar clipping function defined as 

X - CLIP I (M-(S'-M)) 
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where : 

S f is the mean value of the four next near- 
est neighboring samples that straddle the boundary 
between the light and dark members of the four near- 
5 est neighboring samples. 

Brief Description of the Drawing s 

Modes of carrying out the invention are 
described with respect to the drawings wherein: 

FIG, 1 is a schematic diagram of a single- 
10 chip color image sensor having a checkerboard 

luminance sampling pattern; 

FIG. 2A is an idealized diagram showing the 
luminance values in a portion of an image having 
a sharp vertical edge; 
15. FIG - 2B shows the sampled luminance values 

obtained by sampling the idealized image shown in 
FIG. 2A with the luminance sampling pattern of. 
FIG. 1; 

FIG. 2C shows the luminance values obtained 
20 by interpolating the values between sampled 

luminance values in FIG. 2B with two-dimensional 
linear interpolation; 

FIG. 3A is an idealized diagram showing the 
luminance values of a narrow vertical line; 
25 FIG. 3B shows the sampled luminance values 

obtained by sampling the Image of FIG. 3A with 
the luminance sampling pattern of FIG. 1; 

FIG. 3C shows the luminance values obtained 
by interpolating the values between sampled 
30 luminance values In FIG. 3B with two-dimensional 

linear interpolation; 

FIG. 4 shows the luminance values obtained 
by interpolating the values between the sampled 
luminance values of FIG. 2A using the median of 
35 neighboring sampled values; 
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FIG. 5 shows the luminance values obtained 
by interpolating the values between sampled 
luminance values in FIG. 3B using the median of 
neighboring sampled values; 
5 FIGS. 6A-6B show the geometrical feature 

classified as. an edge in an embodiment of the 
signal processing method according to the 
invention; 

FIG. 6C shows the geometrical feature clas- 
10 sified as a stripe in an embodiment of the signal 

processing method according to the invention; 

FIG. 6D shows the geometrical feature clas- 
sified as a corner in an embodiment of the signal 
processing method according to the present 
15 invention; 

FIGS. 7A-7B" show patterns useful in describ- 
ing the interpolation method for stripes; • 

FIGS. 8A-8C show patterns useful in 
describing the interpolation method for corners; 
20 FIG. 9 is a schematic diagram showing com- 

puter controlled apparatus for generating, pro- 
cessing and displaying a sampled image signal; 

FIG. 10 is a block diagram useful in 
describing the functions performed by the digital 
25 computer; and 

FIGS. 11-14 are flow charts useful in ex- 
plaining the signal processing method according 
to the present invention. 
Modes of Carrying Out the Invention 
30 The invention will be illustrated with an 

example of a signal processing method for sampled - 
image signals, where the image is intended for human 
viewing. The features that are presumed to be in the 
image are lines, sharp edges, and corners, features 
35 to which the human visual system is particularly sen- 
sitive. 
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As noted above, interpolating values between 
sampled values in a sampled image signal by using the 
mean value of the four nearest neighboring samples 
fails to preserve image features such as sharp edges 

5 or thin stripes when the image is reconstructed from 
the processed image signal. These reconstruction 
errors are particularly noticeable to the human ob- 
server, because they are features to which the human 
visual system is most sensitive* If, instead of the 

10 mean value of the four nearest neighbors, a median of 
the four nearest neighbors is used, the sharp edge 
and the thin line are reproduced as shown in FIGS. 4 
and 5 respectively. The median M is defined here as 
the value halfway between the values of the two 

15 samples having middle values when the four samples 
are ranked A >. B C ^> D. 

vr ■ B"" + * C 

- — 2 (1) 

As can be seen in FIG. 4, the median M is , an appro- 

20 priate interpolation routine for reconstructing the 
sharp edge, but as shown in FIG. 5, the stripe is 
still modulated with a pattern corresponding to the 
sampling pattern of the image sensor. A different 
interpolation routine is required to reconstruct the 

25 stripe. ; 

Appropriate interpolation routines are 
determined by the image sampling pattern and the 
features that are presumed to exist in the image. 
The appropriateness of an interpolation routine may 

30 be assessed by processing a representative group of 
images with the interpolation routine and measuring 
the RMS reconstruction errors for the particular 
features being reconstructed. 

However, before an appropriate interpolation 

35 routine is described for the stripe feature, means 

will be described for identifying the features in the 
local neighborhoods so that an appropriate interpola- 
tion routine can be applied. 
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To identify the local feature, the four 
nearest neighboring sampled values (above, below and 
both sides) of the interpolation location are classi- 
fied as either greater than (H) , or less than (L) the 
5 mean value (m) of the four neighboring sample values, 
where 

4 

m = N i 4 <2) 

where : 

1° N i are tlie neighboring sampled values. 

There are three possible patterns, their 
rotations and mirror images. These patterns are 
called the EDGE, STRIPE, and the CORNER patterns. 
The EDGE is shown in FIGS. 6A and 6B, the STRIPE is 

15 shown in FIG. 6C, and the CORNER is shown in FIG. 

6D. The X in the FIGS. 6A-D indicates the interpola- 
tion location. An appropriate interpolation routine 
for. the EDGE pattern (the median) was described 
above. For the STRIPE pattern, there are two simple 

20 cases, a vertical stripe shown in FIG. 7A, and a 

horizontal stripe shown in FIG. 7B. These two cases 
are not distinguished using only the four nearest 
neighbors . 

To distinguish the two cases, the .eight next 
25 nearest neighbors are included in the interpolation 
routine and an appropriate interpolated value is the 
CLIP function: 



X - CLIP I (M-(S-M)) (3) 

30 where: 

B and C are the middle ranked sample values 
of the four nearest neighbors as described above, 

M is the median value as defined by equation 

(1), 

35 
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S is the mean value of the eight next 
nearest neighboring samples, and 

CLIP £ (i) « J if (j < i or i < j < k) 

i if k < i < j 
5 k if (i < k or i < k < j) . 

Applying this interpolation routine to the samples of 
the stripe pattern shown in FIG. 3b, it is seen that 
the procedure properly reconstructs the original 
10 stripe pattern without reconstruction errors. For 
example, using formula (3) at interpolation location 
X of Fig. 3B gives: 

X - CLIP ^ (50- (0-50)) « CLIP ^ 100 - 100 

15 To provide input data for the interpolation routine 
near the top and bottom of the portion of the image 
shown iti FIG. 3b , it is assumed that the stripe 
pattern extends in the vertical direction. ■■- " 

Similarly, for the CORNER pattern, there are 

20 several possibilities that are not distinguished by 
the four nearest neighbors, i.e. a light corner on a 
dark background (FIG. 8A) , a diagonal edge (FIG. 8B) , 
and a dark corner on a light background (FIG. 8C) . 
To distinguish these three cases, four more next 

25 nearest neighboring samples are used. The samples 
used are the ones that straddle the boundary between 
the light and dark members of the fo^ir nearest neigh- 
bors and are indicated by stars (*) in FIGS. 8A-C) . 

An appropriate interpolation routine that 

30 reconstructs the corner feature is the CLIP function: 

X - CLIP * ( M -(S , -M)) 

where : 



35 



X is the interpolated value, 

CLIP J (i) is defined as above, 
M is the median value of the four nearest 
neighboring samples , and 



BNSOOCID: <WO 860 1 1 J_> 



WO 86/01966 



PCT/US85/01632 



-ID- 
S' is the mean value of the four next 
nearest neighboring samples that straddle the 
light /dark boundary. 

In 5-10% of the interpolation neighborhoods 
5 of the average photographic image, the classification 
as EDGE, STRIPE, .or CORNER is ambiguous because 
neighboring sample values are either equal to each 
other or to the mean (m) . Neighborhoods that_could 
be either EDGE or CORNER, are preferably treated as 
10 EDGE, and neighborhoods where all the samples are 
equal are properly treated by the median interpola- 
tion routine. Accordingly, the following patterns, 
their rotations and mirror images are classified as 
EDGE. 

15 H L H m m L 

HLLHHLHLmmLH 
H L m - m. m m 

Neighborhoods that could be either STRIPE or EDGE are 

better treated as STRIPE, and neighborhoods that 

could be classified as STRIPE or CORNER, are treated 

the same by either the STRIPE or the CORNER method* 

Accordingly, the following patterns, their mirror 

images and rotations are classified as STRIPE. 

H H L H 

LLLLHHLm 
2^ ^ m m 

The only remaining pattern is the CORNER. 

H 

L H 
L 

Referring now to FIG. 9, apparatus for 
30 generating, processing and displaying a sampled image 
signal is shown. An image sensor 40, such as a. CCD 
frame transfer image sensor, having a checkerboard 
luminance sampling pattern like that shown in FIG. 1, 
produces a sampled analog signal on line 42. The 
35 sampled analog signal is converted to a digital 
signal by an analog-to-digital converter 44. The 
digital signal is supplied to a digital computer 46 
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on a data bus 48. The digital computer 46 performs 
the signal processing according to the present inven- 
tion to interpolate luminance values between the 
luminance samples of the signal. The computer in- 
5 eludes a frame store 50, f or storing the unprocessed 
image signal and the processed image signal including 
the interpolated sample values, a central processing 
unit (CPU) 52, and random access and read only memo- 
ries (RAM and ROM) 54 and 56 for storing the "programs 
10 that control the computer 52. The frame store may 
comprise either a digital frame store comprising 
solid state memory elements, or a- conventional memory 
device such as magnetic tape or disc storage. The 
processed digital signal is supplied to an output 
15 device such as a CRT 58 or a graphic arts scanner 60 
via digital-to-analog converter 62. 

Although the elements .of the apparatus are 
shown physically connected by bus 48 in FIG; 9, the 
elements may be separated and the signals .carried 
20 between the elements by storage media. For example, 
the sampled analog signal from the image sensor may 
be recorded directly on a magnetic tape recorder and 
later supplied to the computer for signal process- 
ing. Similarly, the processed sampled image signal 
25 may be recorded for later display. ; 

Although the invention was reduced to prac- 
tice using a general purpose digital computer, it 
will be apparent to one skilled in the art, that a 
programmed microprocessor, or custom designed inte- 
30 grated circuits can be used to practice the invention. 

The signal processing function performed by 
the computer will now be described with reference to 
the block diagram of FIG. 10 and the flow charts of 
FIGS. 11-14. 

35 Referring first to FIG . 10, the computer 46 

is programmed to implement a plurality of signal pro- 
cessing means 64, 66 and 68 responsive to the sampled 
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signal values in the image signal S for producing 
interpolated signal values S 1 appropriate for com- 
pleting a line, edge or corner feature, respective- 
ly. A feature detecting means 70 is responsive to 
5 the sampled signal values in the sampled image signal 
S in the neighborhood of an interpolation location 
for detecting which of the geometric features is 
represented by the signal values, for producing a 
signal representative thereof. Signal processor 
10 selecting means 72 is responsive to the signal from 
the feature detecting means for selecting the appro- 
priate signal processing means for producing the 
interpolated signal value. The appropriate signal 
processing means is selected, as indicated schematic- 
15 ally by multiple position switch 74 controlled by 
signal processor selecting means 72, to produce the 
interpolated signal value S' . 

Referring now to FIG. 11, the computer pro- 
gram will be described with reference to the flow 
20 charts. The computer 46 retrieves the luminance 

values of the four nearest neighboring samples sur- 
rounding the interpolation position from the frame 
store memory 50. The mean value (m) of the four 
nearest neighbors is calculated. Next, the value of 
25 each neighbor N i is compared with the mean value m 
to determine whether it is larger (H) , smaller (L) , 
or equal to (m) the mean. The resulting pattern of 
H's, L*s and m's is checked to determine whether it 
is an EDGE pattern, a STRIPE patter or a CORNER pat- 
30 tern, by checking the pattern of H's, L's and m's 
with templates stored in the computer. 

If the pattern is determined to be an EDGE, 
the interpolated value X is determined as shown in 
F ^G. 12 by computing the median value M defined as 
35 the average of the two central valued samples in the 
four sample neighborhood. 
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If the pattern is a STRIPE, the interpolated 
value X is determined as shown in FIG. 13. First the 
four neighboring samples are ranked and the median M 
is determined. The eight next nearest samples are 
5 retrieved from memory and the mean S of the eight 

next nearest samples is found. Then the CLIP function 
Y - CLIP * (M-(S-M)) 

is used to define the interpolated value X - Y. 

10 x f the pattern is a CORNER, the interpolated 

value is found as shown in FIG. 14. First the median 
M of the four nearest neighbors is determined. The 
four next nearest neighbors that straddle the bound- 
ary between the light and dark members of the four 

15 nearest neighbors are retrieved from the frame store 
and their mean S' is found. M and S* are then used 
in the CLIP function 

Z - CLIP g (M-(S'-M)) 

20 to determine the interpolated value X » Z. When the 
interpolated value is found, the value is stored in 
the frame store and the program returns to the begin- 
ning to compute the next interpolated value. The 
process is repeated until all the interpolated values 

25 between sample values in the sampled luminance signal 
have been provided. Alternatively, the computer cal- 
culates the interpolated values, combines the inter- 
polated values with the sample values, and displays 
the processed signal real time. 

30 The signal processing method was applied to 

sampled image signals generated by sampling several 
high resolution photographic images with a checker- 
board sampling pattern. The apparent quality of the 
images reproduced from the processed signals was 

35 improved over the images reproduced from sampled 
image signals that were processed by using linear 
interpolation between the sample values. The appear- 
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ance of geometrical detail in the geometrical fea- 
tures of the reproduced images using *the signal pro- 
cessing method of the present invention was greatly 
improved. Careful scrutiny of the natural textures 
5 such as grass and foliage in the reproduced images 
revealed that the fine details of the natural tex- 
tures had been rendered in a manner reminiscent of a 
cubist painting* However, these reconstruction 
errors were not readily noticeable to the human 
10 observer. 

The invention as described is directed to 
interpolation of luminance signals. In practice, the 
sampled chrominance values are also interpolated, 
using methods known in the prior art to reconstruct a 

15 full color image. 

Although the invention has been described 
with reference to a preferred embodiment wherein a 
human viewable image was sampled in a checkerboard 
pattern, the invention can be applied to other samp- 

20 ling patterns such as stripe patterns where the dis- 
tances between the samples is different in two dimen- 
sions, and also for patterns where the distances 
between the samples occur irregularly in either one 
or both dimensions. The invention can also- be used 

25 for machine viewable images, where the prior knowl- 
edge of the features in the images are determined by 
the machine environment. 

Although the invention has been described as 
being embodied by signal processing apparatus having 

30 a full-frame store, it will be apparent to one 

skilled in the art that the apparatus need store only 
a few lines of the image signal at one time in order 
to perform the signal processing method. 
Advantages and Industrial Applicability 

35 Th ® signal processing method has the advan- 

tage of reducing the reconstruction errors in an 
image reproduced from a sampled image signal. In one 
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mode of the invention for processing human viewable 
images, the signal processing method has the further 
advantage of improving the appearance of a reproduced 
image by causing the reconstruction errors to occur 
5 principally in parts of the image (natural textures) 
where they are not noticeable to the human observer. 
The invention also has the advantage that when used 
to process a signal produced by an image sensor of a 
given size, an image can be produced having the same 

10 apparent image quality as the conventionally pro- 
cessed image reproduced from the signal from an image 
sensor having many more image sensing elements. The 
invention is useful in amateur or professional video 
and still imaging apparatus, in graphic arts appara- 

15 tus for reproducing images from sampled image signals 
and in machine vision systems. 



20 
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30 
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I CLAIM: 

1. A signal processing method for produc- 
ing interpolated signal values between sampled signal 
values in a sampled image signal characterized by: 

5 providing a plurality of different interpo- 

lation routines for producing interpolated signal 
values that complete a respective plurality of 
known geometrical image features; 

detecting which of the known geometrical 
10 image features is represented by a neighborhood 

of -sample values; and 

applying the interpolation routine appro- 
priate for completing the detected feature to the 
neighboring sample values to produce the inter- 
15 polated signal value. 

2. The invention claimed in Claim 1, 
wherein the known geometrical features comprise 
edges, stripes and corners , 

3. The invention claimed in Claim 2, 
20 wherein the sampled image signal is produced by a 

checkerboard sampling pattern, the geometrical fea- 
tures are detected by the values of the four nearest 
neighboring samples such that the patterns: 

H L H ni m l 

2 5 H L L H H L H L m m L ; H 

H L m m m m 

their rotations and mirror images are detected as 
edges, the patterns; 

H H L H 

LLLLHHLm 
2 o H* m m m 

their rotations and mirror images are detected as 

stripes, and the pattern 

H 

L H 
L 

35 its rotations and mirror images are detected as a 
corner, where 
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m is the mean value of the four nearest 
neighboring samples , 

H indicates a sample value greater than the 

mean , 

5 L indicates a sample value less than the 

mean; and 

the interpolation routine for edge features 
comprises producing the median value M of the four 
nearest neighboring samples; the interpolation 
10 routine for the stripe feature comprises producing 
the value of the clip function 

X - CLIP * (M-(S-M)) 

where : 

15 X is the interpolated value, 

A B iL c L D ar ® the values of the 
four nearest neighboring samples in rank order, 

B + C 



20 



25 



M 

2 

S is the. mean value of the eight next 
nearest neighboring samples; and 

CLIP J (i) « j if (j < i or i < j < k) 

i if k < i < j 
k If (i < k or i k < j). 



the interpolation routine for corner features com- 
prises producing the value of the clip function 

X - CLIP I ( M -(S f -M)) 

30 where: 

S 1 is the mean value of the four next near- 
est neighboring samples that straddle the boundary 
between the light and dark members of the four near- 
est neighboring samples. 
35 4. Signal processing apparatus for produc- 

ing interpolated signal values between sampled signal 
values in a sampled image signal, comprising: 
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a plurality of signal processing means 
responsive to sampled signal values in the neigh- 
borhood of an interpolation location for produc- 
ing interpolated signal values appropriate for 
5 completing a respective plurality of known geo- 

metrical features ; 

feature detecting means, responsive to 
sampled signal values in the neighborhood- -of an 
interpolation location for detecting which of the 
10 plurality of known geometrical features is repre- 

sented by the sample values in the neighborhood 
and producing a signal representative thereof; and 

signal processor selection means responsive 
to the signal produced by the feature detecting 
15 means for selecting an appropriate one of the 

plurality of signal processing means for produc- 
ing the interpolated signal value, 

5. The invention claimed in Claim 4, 
wherein the signal processing means include means for 

20 producing signal values appropriate for completing an 
e dge, a stripe, and a corner, 

6, The invention claimed in Claim 5, 
wherein the apparatus is adapted for processing sig- 
nals produced by a checkerboard sampling pattern, the 

25 detecting means being responsive to the four nearest 
neighboring sample values to produce a signal repre- 
senting the patterns: 

H L H m m L 

HLLHHLHLm mLH 
H L m m m m 

30 

their rotations and reflections as edges, the 
patterns; 

H H L H 

LLLLHHLm 
H m m m 

35 their rotations and reflections as stripes, and the 

pattern 

H 

L H 
L 
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its rotations and reflections as a corner, where: 

m is the mean value of the four nearest 
neighboring samples, 

H indicates a sample value greater than the 

5 mean , and 

L indicates a sample value less than the 

mean ; and 

the signal processing means include . means 
for producing a signal representing the median value 
10 M of the four nearest neighboring samples for the 
edge feature; mean for producing a signal 
representing the value of the clip function for the 
stripe feature 

X - CLIP * (m-(S-M)) 



15 



25 



where : 

X is the interpolated value, 
• A IB > C > D are the values of 'the - 
four nearest neighboring samples in rank order, 

20 B + C 

M = 

2 

S is the mean value of the eight next near- 
est neighboring samples; and 

CLIP j (i) - jlf (j<iori < -j < k) 

i if k < i < j 
k if U < kor i < k < j). 

means for producing a signal representing the value 
of the clip function for the corner 

30 X - .CLIP I (M-(s'-M)) 

where : 

S' is the mean value of the four next near- 
est neighboring samples that straddle the boundary 
35 between the light and dark members of the four near- 
est neighboring sample values. 
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